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The study of stochastic systems has received considerable interest over the years. Their dynamics 
can describe many equihbrium and nonequihbrium fluctuating systems. At the same time, nonequi- 
librium constraints interact with the time evolution in various ways. Here we review the dynamics of 
stochastic systems from the viewpoint of nonequilibrium thermodynamics. We explore the effect of 
external thermodynamic forces on the possible dynamical regimes and show that the time evolution 
can become intrinsically different under nonequilibrium conditions. For example, nonequilibrium 
systems with real dynamical components are similar to equilibrium ones when their state space 
dimension < 5, but this equivalence is lost in higher dimensions. Out of equilibrium systems thus 
present new dynamical behaviors with respect to their equilibrium counterpart. We also study the 
dynamical modes of generalized, non-stochastic evolution operators such as those arising in counting 
statistics. 



I. INTRODUCTION 

The concept of thermodynamic equilibrium, first defined as a state where no macroscopic changes occur, has 
gradually evolved over the years. In the context of chemical reactions, Wegscheider [T] pointed out that the condition 
of vanishing rate does not necessarily coincide with the thermodynamic equilibrium condition. Indeed, stationarity 
does not rule out the possibility of circular processes, characterized by the presence of matter fluxes. This situation, 
which became known as Wegscheider's paradox, was invoked by Lewis [2 as part of the justification for his general 
law of entire equilibrium, which requires that every elementary process shall have a reverse process and that their 
rates must balance at equilibrium. These assumptions were subsequently named microscopic reversibility principle or 
detailed balance conditions. 

It was not, however, until the fifties that the violation of detailed balance was quantitatively associated with 
nonequilibrium properties by Klein [3j in the context of stochastic models. Afterwards, Hill [4 expressed an irreversible 
entropy production in terms of fluxes and affinities, in analogy with macroscopic thermodynamics. These fluxes and 
affinities measure the breaking of detailed balance along the cyclic trajectories of the system [4 . Schnakenberg [5] 
and others ^ studied this form of the entropy production from a statistical point of view, starting from the Gibbs 
entropy. These works extend a result of Kolmogorov [7^ , who proved that a Markov process is reversible if and only 
if all cyclic trajectories satisfy the detailed balance conditions, to the nonequilibrium realm. 

In parallel, the general research on far-from-equilibrium systems was pioneered by Prigogine [El |9]. In the linear 
regime, equilibrium states are modified by the constraints preventing the system to reach equilibrium, but no new 
structure appears. This situation changes drastically under far-from-equilibrium conditions, where coherent space-time 
behaviors can emerge. Spectacular examples are oscillatory Turing patterns in the Belouzov-Zhabotinsky reaction or 
convection rolls in the Rayleigh-Benard instability. Nonequilibrium conditions can thus be a source of spatio-temporal 
order. Additional forms of self-organization such as the appearance of long-range correlations [lOl [11] and spatial 
information HH |13] out of equilibrium have been documented as well. 

These progresses uncovered general principles of nonequilibrium self-organization and suggested fundamental differ- 
ences between equilibrium and nonequilibrium dynamics. Yet, the effect of external thermodynamical driving forces 
on the time evolution is subtle as, even in their absence, the relaxation towards a steady state is a nonequilibrium 
dissipative process. In this regard, exact mappings between nonequilibrium processes and equilibrium ones exist in 
different circumstances. A first example is found in the chemical network 

A^X^B, (1) 

where the concentrations of species A and B are maintained constant in time. When their chemical potentials 
are not identical the system is kept out of equilibrium and a flux of matter will flow along the potential gradient. 
Nevertheless, the time evolution of the system can be mapped onto an equilibrium system of the form C ^ X by 
effectively regrouping the kinetic constants and the two species into a single reaction [14]. More complex, nonlinear 
reactions networks can be similarly mapped onto equilibrium systems. This is for instance the case of Schlogl's model 
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A + 2X ^ 3X (2a) 
B + X ^ C, (2b) 

which can show multiple steady states and represents a simple model of first-order nonequilibrium transition. In both 
examples several transitions p exist between the same physical states (i.e., the transitions X ^ X ± 1 can occur 
through reaction A or B). These different pathways must be accounted for in the thermodynamic description of the 
system, but can be merged into a single effective pathway leaving the dynamics invariant. Here the resulting system 
can be shown to necessarily satisfy the detailed balance conditions (see [16^ and below) so that the chemical network 
([2| displays an equilibrium-like dynamics for all concentrations and reaction rates. 

Another class of systems that can be mapped onto an equilibrium motion are driven Brownian motion [iTl [18] . A 
typical example consists in a Brownian particle trapped in a confining potential V, which is experimentally realized 
by optical tweezers [191 HO] • The system is then driven out of equilibrium by imposing a viscous flow of velocity u 
and friction coefficient a. The resulting drag force moves the Brownian particle away from the potential well and 
generates a corresponding dissipation. Nonetheless, the Brownian motion can be viewed as an equilibrium random 
motion in the effective potential = V -\- auz. Here also, the nonequilibrium conditions do not alter the intrinsic 
dynamics of the system. 

Finally, a class of one-dimensional transport models presenting an equilibrium-like dynamics has been recently 
discovered. Tailleur et al. [2TJ [22] demonstrated that these models can be taken through a non-local transformation 
into isolated systems satisfying detailed balance. 

These observations bring forth several questions of interest. Is the dynamics intrinsically different under nonequi- 
librium conditions? If so, what are the qualitative and quantitative differences that may occur and when? In this 
paper we explore these questions in the context of Markovian stochastic systems. We first review their spectral 
properties, using the Jordan- Chevalley decomposition to identify the different dynamical modes. Building on 
recent results from linear algebra, we study the possible local and global behaviors of these dynamical modes. We 
show that the presence of thermodynamic driving forces give rise to qualitatively and quantitatively different dynamics. 



II. STOCHASTIC DESCRIPTION 



In this paper we focus, for the sake of clarity, on Markov chains evolving in discrete time. Similar conclusions can 
be drawn for continuous-time Markov processes using the uniformization procedure j23l [24] . 

A discrete-time Markov chain is defined by a probability distribution p over a state space i G {1,...,A/'}, and 
a transition matrix Tij describing the transition probabilities between those states. The transition matrix is non- 
negative, Tij > 0, and must satisfy the conditions T^j = 1 for probability conservation. 

The probability distribution p evolves in discrete time steps according to 

^(/c+i) =pik)^^ 

If the Markov chain is irreductible and primitive the probability distribution will evolve towards a unique stationary 
state satisfying p^^ = p^^T [24 . This steady state distribution can be expressed in terms of the minors of the transition 
matrix [25] [26] or in terms of its maximal trees [5j [27] . 



III. DYNAMICAL EVOLUTION 



The iteration scheme 

solves the time evolution of the probability distribution but a more transparent form can be achieved. Using the 
Jordan canonical decomposition [28,, a similarity transform T' = U~^TU brings the transition matrix into the form 



T' = diag(Ji,...,J™), 



(5) 
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where Ji is a Jordan block of size rii and eigenvalue A^: 
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(6) 



Notice that, as the transition matrix T is real, all complex eigenvalues come in conjugate pairs. The time evolution 
Q can be written as 



= p(0)[C/diag(Ji,...,J™)C/-Y 
= p(°)f/diag(J^...,J^)C/-i. 



Noting that the Ic^ power of a Jordan block of size n reads 
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we see that the time evolution of the probability distribution can be expressed as 



(7) 



(8) 
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rii - 1 



A? 



(9) 



The coefficients c[*^ are determined by the initial probability distribution p{0) and the generalized eigenvector associ- 
ated with the decomposition ([5| . Accordingly, specifying the set of eigenvalues and Jordan blocks uniquely determines 
the time evolution of the system. 



Each of these contributions has a different impact on the time evolution. We can distinguish four classes of dynamical 
behaviors as follows: an eigenvalue is either real or complex, and occurs either in a Jordan block of size 1 or larger. 
Their respective influence on the dynamical evolution is depicted in Figure [l] In addition to an exponential decay, 
we see that the presence of a complex eigenvalue (and its conjugate) leads to an oscillatory behavior. In parallel, the 
presence of a Jordan block of size greater than one (here n = 2) leads to a large transient component, which can 
be coupled to an oscillatory component or not. These behaviors arise from the terms ex k^X^ (/ = 0, . . . , n — 1) in 
equation ([8| or ([9|. Such transients thus become longer with the size of the Jordan block. Similar results hold in 
continuous-time as well [29] . 

The eigenvalues obey the Perron- Frobenius theorem [28 : 

If A is a X non-negative, primitive, and irreducible matrix, then 

1) there is a real eigenvalue Ai of A such that any other eigenvalue A satisfies |A| < Ai. 

2) there is a left (respectively right) eigenvector associated with Ai having positive entries. 

3) that eigenvalue is a simple root of the characteristic equation of A. 

Probability conservation requires that the rows of a transition matrix sum to unity, which in turn implies that the 
Perron root Ai = 1. The other eigenvalues can be ordered as Ai > IA2I > • • • > |A^|. The eigenvalue Ai = 1 corresponds 
to the stationary state while the second largest eigenvalue A2 characterizes the relaxation towards the steady state. 
Importantly, Karpelevic characterized the complex plane region realizable by the eigenvalues of N x N stochastic 
matrices [3T1|32]. This result does not, however, describe the set of possible combinations of eigenvalues. 



4 



0) 

E 
< 




20 40 60 20 40 60 





Time 



FIG. 1: Contributions of different dynamical modes to the time evolution. The amplitude of each mode is determined 
as the real part of the sum of its components over time: 1 1 J'^ 1 1 = Re |^ ^ . j ( J^) j . In all panels the long-time decay is exponential 
and associated with an eigenvalue of modulus |A| = 0.9. (a) Exponential mode associated with an eigenvalue A = |A|. (b) 
Oscillatory mode corresponding to the complex eigenvalue A = |A|e*^/^. (c) Jordan block of eigenvalue A = |A| and size 2. (d) 
Complex Jordan block of eigenvalue A = |A|e*^/^ and size 2. 



IV. THERMODYNAMIC DESCRIPTION 



Based on the concept of entropy production, a thermodynamic description has been associated with Markov pro- 
cesses E] • A system is out of equilibrium at time k if the irreversible entropy production 

i,j \Pj -'-ji/ 

is positive. This is typically the case when the system relaxes towards its steady state. The relaxation process can 
be driven by internal (due to a non-stationary initial probability distribution) and external (e.g., chemical potential 
gradients between reservoirs) thermodynamic forces. At the steady state the entropy production may vanish, in 
which case the system has reached a state of thermodynamic equilibrium, or present a positive value, in which case 
the system is maintained out of equilibrium by the presence of external thermodynamic forces acting on the system. 



As seen from equation (10), a stationary state is an equilibrium state when the conditions of detailed balance 



p:%=pfT,, (11) 

are satisfied for all the possible forward and backward transitions. That is, every elementary process has a reverse 
process, and their rates balance at equilibrium [Tl|2]. In particular, this implies that no probability flux is present 
at equilibrium. Note that, in the present form, the knowledge of the equilibrium distribution is required to verify 
whether a system satisfies detailed balance at the steady state. 

An equivalent condition, known as Kolmogorov's criterion [7 , can be expressed in terms of the sole transition 



probabilities. The equilibrium conditions (11) are equivalent to: 
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(1) Tij > implies Tji > 0. 

(2) Ti^i^ . . . Ti^i^ = Ti^i^ . . . Ti^i^ for any finite sequence (ii, ^2, • • • , ^n). 



These conditions are necessary and sufficient in order for the steady state of the system to be at equilibrium, 
i.e. a Markov process is reversible if and only if all cyclic trajectories satisfy the detailed balance conditions. A 
direct consequence of this observation is that systems without cyclic paths (other than the (^1,^2) pairs) are always 
at equilibrium, regardless of the transition probabilities. For example, the system 1 ^ 2 ^ 3 satisfies the detailed 
balance conditions for all (positive) transition probabilities. 



The expressions for the entropy production (10) and the detailed balance conditions (11) assume that there is a 



unique transition pathway between states. When several transition pathways p exist between states, as in the chemical 
networks ([T]) or (2|, it is necessary to include them in the thermodynamic formulation. The expressions (11) and (10) 
must be adjusted as follows. The detailed balance conditions (or Kolmogorov's conditions) must hold for all individual 
pathways and transitions: p^^T^^^^ = p^^T^f' . Similarly, the sum over all transitions in the entropy production must 
now include an additional sum over all possible transition pathways. 

Kolmogorov's conditions are equivalent to the symmetrizability of the transition matrix (i.e., it is similar to a 
symmetric matrix). In this case the transition matrix is diagonalizable and all its eigenvalues are real. We will use 
this important observation in our subsequent analysis. The mapping to a symmetric matrix is readily achieved if the 
stationary distribution is known. Indeed, the similarity operator 



U = diag (v^, . . . , v^) 



(12) 



brings T into the form 



T'. 



{UTU- 




(13) 



The latter is symmetric. 



(14) 



when p = p^^ satisfies the detailed balance conditions (11). Alternatively, a similarity transformation independent 
of the equilibrium distribution p^"^ has been derived that brings the system into a symmetric form using only the 
transition probabilities and the topology of the chain [30] . 
When the detailed balance conditions are not satisfied. 



(15) 



the steady state defines a nonequilibrium stationary state. In this case probability fluxes will flow through the system 
and generate thermodynamic forces or affinities [5 . In this way, Kolmogorov's relations, which do not depend on the 
probability distribution, provide an intrinsic measure of the thermodynamic conditions. In the following we thus refer 
to systems satisfying Kolmogorov's conditions as presenting an equilibrium-based dynamics. We emphasize that, 
even in this case, the relaxation process towards the equilibrium distribution is a genuine nonequilibrium process 
characterized by a positive entropy production. 



V. EQUILIBRIUM VERSUS NONEQUILIBRIUM SPECTRUM 

The characterization of a Markov process as presenting an equilibrium- or nonequilibrium-based dynamics rests 
on the absence or presence of external thermodynamic forces. The thermodynamic conditions can be revealed by 
Kolmogorov's relations, which are based on the value of the transition probabilities along the cyclic paths of the 
chain. Similarly, the dynamical evolution results from a complex interplay between the topology of the system and 
its transition probabilities or effective connectivity. In this regard, the effects of thermodynamic driving forces on the 
dynamics itself are difficult to predict. Here the question we want to investigate is the following: Does the presence 
of external thermodynamical forces change the nature of the dynamics, and in what ways? To address this question 
we identify the possible dynamical regimes with or without external thermodynamical driving forces. We show that 
the nonequilibrium conditions determine different classes of dynamical behaviors with respect to an equilibrium-based 
dynamics. 

A first observation is that we can restrict our analysis to the case where only one type of transition exists between 
two states. Indeed, although the presence of several transitions affects the thermodynamic properties of the system 
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FIG. 2: Classification of dynamical modes in terms of thermodynamic conditions, (a) The presence of a complex 
eigenvalue or a Jordan block of size > 1 is characteristic of a nonequilibrium process. When all eigenmodes are real, the 
thermodynamic conditions are uncertain, (b) Subspace of real dynamical modes. When the state space dimension < 5, 
the combinations of real modes accessible under equilibrium or nonequilibrium conditions are identical. When the state space 
dimension N > 5, some combinations of real modes only occur under nonequilibrium conditions. 



(e.g., the entropy production), it is possible to merge all these different pathways onto a unique, effective transition 
without affecting the dynamics itself. In some cases the resulting system can be at equilibrium if it satisfies the 
detailed balance conditions for the total transition probabilities Tij = ^^T^^jK When the resulting system is at 
equilibrium for all values of the transition probabilities (e.g., because it does not present cyclic trajectories), we have 
a robust class of mapping from nonequilibrium systems to equilibrium ones. This is for example the case for the 
chemical networks ([T) and ([2| discussed in the Introduction. 

We can now distinguish different situations, based on the Jordan- Chevalley decomposition of the transition matrix. 
As discussed in Section [TTTj this scheme provides us with the set of eigenvalues and Jordan blocks characteristics of 
the system and its dynamics. 

We first consider equilibrium-based dynamics satisfying Kolmogorov's conditions. In this case the transition matrix 
is symmetrizable so that its eigenvalues are real and the eigenvectors form a complete basis. In particular, this 
implies that neither complex eigenvalues nor Jordan blocks can occur when no thermodynamic forces are present. 
Oscillating dynamical modes and 'slow' transients arising from Jordan blocks can only occur in presence of external 
thermodynamic forces (see Figure [2|l), in contrast with an equilibrium-based dynamics. Another direct consequence 
is that the equilibrium power spectrum is Lorentz-typed [34]; in particular no stohastic resonance can occur at 
equilibrium. This observation already reveals that equilibrium and nonequilibrium systems can exhibit fundamentally 
different dynamics. 



The remaining case to consider occurs when all eigenvalues are real and when no Jordan blocks are present. The 
system is then entirely characterized by the set (Ai, A2, . . . , A^) of eigenvalues. In this situation it is more difficult to 
distinguish equilibrium- from nonequilibrium-based dynamics. We thus investigate the relationships between the set of 
eigenvalues (Ai, . . . , A^) of a stochastic matrix and its thermodynamic properties. As mentioned earlier, Karpelevic's 
theorem [3TJ [32] restricts the domain of possible eigenvalues, but it does not describe the possible combinations of 
eigenvalues of stochastic matrices. This difficult task is known as the inverse eigenvalue problem [35 : given a set of 
eigenvalues and a space of operators, can we find a system that realizes this particular set of eigenvalues? 

In our case, the class of operators of interest corresponds to the space of stochastic matrices with real eigenvalues. 
However, it is easier to study the inverse eigenvalue problem in the space of non-negative operators, referred to as the 
real non- negative inverse eigenvalue problem (RNIEP). The following mapping then relates irreductible non- negative 
matrices to stochastic ones. Consider a non-negative matrix A and denote its Perron root by Ai and its (entrywise 
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positive) right Perron vector by x. Then if D = diag(xi, . . . , xat) we have that 



T= -^D-^AD (16) 



is a stochastic matrix. For our purpose, an additional observation must be made: if A satisfies Kolmogorov's conditions 
then its derived stochastic matrix T also does. This is shown as follows. The transition matrix has elements Tij = 
K^^ik^kiDij = X];'^{l/xi)SikAkiSijXj = X];'^{xj/xi)Aij so that 

for any cycle (^i, • • • , '^n)^ from which we deduce that Ti^i^ . . . T^^^^ = T^^^^ . . . Ti^i^ . This shows that the construction 



(16) preserves the distinction between equilibrium- and nonequilibrium-based dynamics. Consequently, we can study 
the eigenvalues of non- negative matrices and transfer the results to stochastic matrices. 

We can now restate the problem as follows: Can we find a non-negative operator realizing a given set of real 
eigenvalues? More importantly, are there some combinations of eigenvalues that can be realized by a non-negative 
matrix but not by a symmetric one? Partial answers to these questions have started to emerge recently [35l[36]. Here 
we use recent developements in linear algebra to show that nonequilibrium conditions allow for new patterns of real 
dynamical modes. 

Partial results for the inverse eigenvalue problem on stochastic matrices were first obtained by Soule [37] (see 
also ^ ). Later on, the RNIEP problem was solved by Loewy and London when TV < 5 [39 . More recently, the 
problem over the set of symmetrizable matrices was solved by Wumen [40 , also for < 5. Notably, they found the 
same subset in the space of eigenvalues, implying that these two classes of problems are equivalent for < 5. This 
means that systems with low-dimensional state spaces determine the same class of real dynamics, regardless of the 
thermodynamic conditions. 

For higher dimensions, Johnson and coworkers eventually demonstrated that the two classes of problems are not 
equivalent, at least in high dimensions [41 . A final step was accomplished when Egleston derived a class of eigenvalues 
combinations that cannot be realized by any 5x5 symmetrizable matrix [42 . For example, the set of eigenvalues 
(l,|y,— P) is realizable but not by a symmetrizable matrix. We can thus conclude that, for A/" > 5, the 
nonequilibrium conditions extend the range of possible dynamical patterns (Figure ^) . This completes the analysis 
of equilibrium- versus nonequilibrium-based dynamics. 



VI. TIME EVOLUTION OF THERMODYNAMIC FLUCTUATIONS 



The dissipation rate and the thermodynamic currents play an important role in nonequilibrium statistical ther- 
modynamics [5] I9I . The dissipation is related to the irreversible entropy production and the efficiency of free energy 
conversion into useful work. The thermodynamic currents describe the ffuxes of matter or energy ffowing through the 
system. Their response and ffuctuation properties are therefore of fundamental interest, especially, for the exploration 
of nanoscale systems. 

The dynamical properties of such thermodynamic quantities have been recently investigated (see [43] for a review) . 
They are described by the so-called generating functions, which evolve in time according to generalized transition 
operators. Although these operators are not row-stochastic (i.e., their rows don't sum to unity), they are non- negative 
so that a similar analysis can be performed. The natural question is thus whether these thermodynamic quantities 
present a fundamentally different dynamical character than the original state space dynamics. Interestingly, the 
answer turns out to depend on the particular quantity under study. 



We first consider the entropy production fiuctuations of Markov stochastic processes. They are described by a 
generating function, obtained as the Fourier transform {ex.-p{—r]S{k))) of the probability distribution of observing 
a given value of the total dissipation S{k) = XljLi log(Ti^i^^^/Ti^^^iJ along a trajectory of length k. The operator 
describing the time evolution of the generating function reads [311 SS] 

L,M=t!-''T^,. (18) 

We recover the evolution operator of the probability distribution when 7^ = 0. It is readily verified that, when 
the system satisfies Kolmogorov's conditions, this generalized operator describing the time evolution of the entropy 
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FIG. 3: Dynamical modes of the dissipation rate and thermodynamic currents of the cyclic system 1 ^ 2 ^ 3 ^ 1 

at equilibrium. The transition probabilities take the values T12 = T13 = 0.42, T21 = T23 = 0.35, T31 = T32 = 0.4 and 
T^^ = 1 — ^j-^^Tij, which satisfy Kolmogorov's conditions. The current is measured as 613 = —631 = 1 and zero otherwise. 
Left panel: Eigenvalues of the dissipation rate fluctuations operator (18). They are real for all values of the parameter 77. 
Right panel: Eigenvalues of the current fluctuations operator (21). They present (conjugate) complex components for |?7| > ?7c, 
indicating an oscillating behavior in the time evolution. 



production fluctuations also satisfies these conditions. Indeed, for any cycle (^1,^2, • • • , ^n) we have 

/T T T- • \ ^ 

7- r { \ _ rp T I ^i^ri^^n^n-i • • • -^^2^l \ 

J^iii2 • • • ^inii yl) ~ -^iii2 • • • -'-inii 1 I 

\ ■^1112 • • • -'-inii J 

where we used Kolmogorov's condition Ti^i^ . . .Ti^i^ = Ti^i^Ti^i^_^ . . .Ti^i-^. By virtue of the latter equality we also 
have 

Liii2 • • • Li^i^ (77) = Li-^i^Li^i^_-^ . . . Li^i^ {rj) (20) 

for all values of rf. Consequently the operator ([l8| is symmetrizable and its eigenvalues are real with no Jordan blocks 
of size n > 1 ^46j. Therefore, the entropy production and its equilibrium fluctuations always present a time evolution 
quantitatively similar to the probability distribution, i.e. characterized by exponential decay modes belonging to the 
same set as those of the probability distribution itself. 

The situation differs considerably for the thermodynamic currents. For our purpose it is sufficient to consider the 
case where only one thermodynamic current is present. In this case the total current along a trajectory is obtained 
as G{k) = Yl\=i ^iik+i^ where Cij = —cji takes the value ±1 if the transition i ^ j generates a positive (negative) 
current, and zero otherwise. The operator describing the time evolution of the generating function {ex.-p{—r]G{k))) 
reads [H \^ 

L,,(7y)=T,,e-^--^. (21) 

Even for systems at equilibrium this evolution operator does not, however, satisfies Kolmogorov conditions. For 
example, a cycle associated with a single current pulse would yield 

^1112 • • • ^in^i -^iii2 • • • ^'in'ii ^ ^ 

Illn 1n1n-l ' ' ' -^^2*1^ 

^ ri,i„Ti„,„_,...r,,,,e+'' = Li,i„L,„,„_,...Li,i,(7?) (22) 

for 7^ 7^ 0. The thermodynamic currents may thus display more complex behaviors (slow transients, oscillations) than 
those observed in the state space time evolution, even for equilibrium systems. This is illustrated in Figure [3] where 
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we observe, on the simple system 1 ^ 2 ^ 3 ^ 1, that the current operator can present complex modes. Thus, the 
present approach also serves as a basis to study and classify the dynamical properties of further thermodynamical 
quantities of interest. 



The dynamics of stochastic systems emerges from a complex interplay between their topology and their effective 
connectivity (as measured by the transition probabilities). On the other hand, nonequilibrium conditions generate 
dissipation that in turn affects the time evolution. Interestingly, the presence of external thermodynamic forces is 
revealed at the level of the effective connectivity, as described by Kolmogorov's conditions. 

Intrinsic differences between equilibrium-based and nonequilibrium-based dynamics can be uncovered. These dif- 
ferences may take different, possibly coexisting, forms. First, complex dynamical modes can only appear out of 
equilibrium. They generate oscillatory components in the time evolution (Figures [l]:), d). Second, the presence of Jor- 
dan blocks only occurs under nonequilibrium conditions. These contributions give rise to slow dynamical components 
in the time evolution (Figures d). 

When none of those phenomena are present, the time evolution displays a uniform relaxation towards the steady 
state. The combination of then real eigenvalues determines the dynamics of the system. Notably, when the state 
space is low-dimensional {N < 5) the possible combinations of eigenvalues are strictly identical for equilibrium and 
nonequilibrium systems. In this sense they are indistinguishable and the nonequilibrium conditions do not increase 
the range of possible behaviors. In contrast, when > 5 the diversity of possible patterns is enlarged (Figure [2b) 




and additional dynamical behaviors become possible. 

We have also considered the fluctuations of thermodynamical quantities such as the dissipation rate and the thermo- 
dynamic currents. Their time evolution can be described by non- negative operators similar to a transition matrix, but 
with the important difference that their largest eigenvalue is diffeerent from one. The resulting equilibrium dynamical 
behaviors can be similar to the time evolution of the state space probability distribution, as for the dissipation rate, 
or intrinsically different, as for the thermodynamic currents (Figure [3|. In particular, the thermodynamic fluxes can 
present a nonequilibrium-like behavior even when the underlying system is at equilibrium. 

These differences may, at first glance, appear surpising. Indeed, for a given system, the set of admissible trajectories 
is identical under equilibrium and nonequilibrium alike. The only difference comes from the statistical weight given 
to these trajectories. Yet the dynamical modes may become qualitatively different under nonequilibrium conditions. 
The detailed connection between the dynamical modes, which are global quantities, and the trajectories remains to 
be explored. 

Further interesting questions can be envisaged based on the present results. For instance, experimental observations 
often offer limited information on the system. The present approach may be used to discriminate between equilibrium 
and nonequilibrium dynamics on the basis of data obtained from a subset of the total phase space (see also [48^). 
Indeed, observing a subset of the full state space can be sufficient to identify several of the dynamical modes 
involved and thus distinguish between a global equilibrium or nonequilibrium state. Determining the thermodynamic 
conditions is especially relevant in the study of biochemical networks, enzyme kinetics, or molecular motors. 
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